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CIRCUIT AND METHOD FOR INSTRUCTION COMPRESSION 
AND DISPERSAL IN WIDE -ISSUE PROCESSORS 

CROSS-REFERENCE TO RELATED APPLICATIONS 

The present invention is related to those disclosed in the 
following United States Patent Applications: 

1) Serial No. [Docket No. 00-BN-051] , filed 
concurrently herewith, entitled "SYSTEM AND METHOD FOR 
EXECUTING VARIABLE LATENCY LOAD OPERATIONS IN A DATA 
PROCESSOR" ; 

2) Serial No. [Docket No. 00-BN-052] , filed 
concurrently herewith, entitled "PROCESSOR PIPELINE STALL 
APPARATUS AND METHOD OF OPERATION" ; 

3) Serial No. [Docket No. 00-BN-053] , filed 
concurrently herewith, entitled "CIRCUIT AND METHOD FOR 
HARDWARE -ASSISTED SOFTWARE FLUSHING OF DATA AND 
INSTRUCTION CACHES"; 

4) Serial No. [Docket No. 00-BN-054] , filed 
concurrently herewith, entitled "CIRCUIT AND METHOD FOR 
SUPPORTING MISALIGNED ACCESSES IN THE PRESENCE OF 
SPECULATIVE LOAD INSTRUCTIONS" ; 

5) Serial No. [Docket No. 00-BN-055] , filed 
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concurrently herewith, entitled "BYPASS CIRCUITRY FOR USE 
IN A PIPELINED PROCESSOR"; 

Serial No. [Docket No. 00-BN-056] , filed 
concurrently herewith, entitled "SYSTEM AND METHOD FOR 
EXECUTING CONDITIONAL BRANCH INSTRUCTIONS IN A DATA 
PROCESSOR" ; 

Serial No. [Docket No. 00-BN-057] , filed 
concurrently herewith, entitled "SYSTEM AND METHOD FOR 
ENCODING CONSTANT OPERANDS IN A WIDE ISSUE PROCESSOR" ; 

Serial No. [Docket No. 00-BN-058] , filed 
concurrently herewith, entitled "SYSTEM AND METHOD FOR 
SUPPORTING PRECISE EXCEPTIONS IN A DATA PROCESSOR HAVING 
A CLUSTERED ARCHITECTURE"; 

Serial No. [Docket No. 00-BN-066] , filed 
concurrently herewith, entitled "SYSTEM AND METHOD FOR 
REDUCING POWER CONSUMPTION IN A DATA PROCESSOR HAVING A 
CLUSTERED ARCHITECTURE" ; and 

Serial No. [Docket No. 00-BN-067] , filed 
concurrently herewith, entitled "INSTRUCTION FETCH 
APPARATUS FOR WIDE ISSUE PROCESSORS AND METHOD OF 
OPERATION" . 

above applications are commonly assigned to the assignee 
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of the present invention. The disclosures of these related patent 
applications are hereby incorporated by reference for all purposes 
as if fully set forth herein. 

TECHNICAL FIELD OF THE INVENTION 

5 The present invention is generally directed to data processors 

and, more specifically, to an apparatus for compressing and 

a 

*:3 dispersing instructions a wide-issue data processor. 

u 

f 

lin BACKGROUND OF THE INVENTION 
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The demand for high performance computers requires that state- 



ly of-the-art microprocessors execute instructions in the minimum 
amount of time. A number of different approaches have been taken 
to decrease instruction execution time, thereby increasing 
processor throughput. One way to increase processor throughput is 
to use a pipeline architecture in which the processor is divided 
15 into separate processing stages that form the pipeline. 

Instructions are broken down into elemental steps that are executed 
in different stages in an assembly line fashion. 

A pipelined processor is capable of executing several 
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different machine instructions concurrently. This is accomplished 
by breaking down the processing steps for each instruction into 
several discrete processing phases, each of which is executed by a 
separate pipeline stage. Hence, each instruction must pass 
5 sequentially through each pipeline stage in order to complete its 
execution. In general, a given instruction is processed by only 
one pipeline stage at a time, with one clock cycle being required 
for each stage. Since instructions use the pipeline stages in the 
*,3 same order and typically only stay in each stage for a single clock 
IB cycle, an N stage pipeline is capable of simultaneously processing 

r - 
r. 

i"~ 

j;fl N instructions. When filled with instructions, a processor with N 

<.~ pipeline stages completes one instruction each clock cycle. 

M The execution rate of an N-stage pipeline processor is 

fU theoretically N times faster than an equivalent non-pipelined 

IS processor. A non-pipelined processor is a processor that completes 
CD 

execution of one instruction before proceeding to the next 
instruction. Typically, pipeline overheads and other factors 
decrease somewhat the execution rate advantage that a pipelined 
processor has over a non-pipelined processor. 
20 An exemplary seven stage processor pipeline may consist of an 

address generation stage, an instruction fetch stage, a decode 
stage, a read stage, a pair of execution (El and E2) stages, and a 
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write (or write-back) stage. In addition, the processor may have 
an instruction cache that stores program instructions for 
execution, a data cache that temporarily stores data operands that 
otherwise are stored in processor memory, and a register file that 
also temporarily stores data operands. 

The address generation stage generates the address of the next 
instruction to be fetched from the instruction cache. The 
instruction fetch stage fetches an instruction for execution from 
the instruction cache and stores the fetched instruction in an 
instruction buffer. The decode stage takes the instruction from 
the instruction buffer and decodes the instruction into a set of 
signals that can be directly used for executing subsequent pipeline 
stages. The read stage fetches required operands from the data 
cache or registers in the register file. The El and E2 stages 
perform the actual program operation (e.g., add, multiply, divide, 
and the like) on the operands fetched by the read stage and 
generates the result. The write stage then writes the result 
generated by the El and E2 stages back into the data cache or the 
register file. 

Assuming that each pipeline stage completes its operation in 
one clock cycle, the exemplary seven stage processor pipeline takes 
seven clock cycles to process one instruction. As previously 
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described, once the pipeline is full, an instruction can 
theoretically be completed every clock cycle. 

The throughput of a processor also is affected by the size of 
the instruction set executed by the processor and the resulting 
complexity of the instruction decoder. Large instruction sets 
require large, complex decoders in order to maintain a high 
processor throughput. However, large complex decoders tend to 
increase power dissipation, die size and the cost of the processor. 
The throughput of a processor also may be affected by other 
factors, such as exception handling, data and instruction cache 
sizes, multiple parallel instruction pipelines, and the like. All 
of these factors increase or at least maintain processor throughput 
by means of complex and/or redundant circuitry that simultaneously 
increases power dissipation, die size and cost. 

In many processor applications, the increased cost, increased 
power dissipation, and increased die size are tolerable, such as in 
personal computers and network servers that use x86 -based 
processors. These types of processors include, for example, INTEL 
PENTIUM™ processors and AMD ATHLON™ processors. 

However, in many applications it is essential to minimize the 
size, cost, and power requirements of a data processor. This has 
led to the development of processors that are optimized to meet 
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particular size, cost and/or power limits. For example, the 
recently developed TRANSMETA CRUSOE™ processor greatly reduces the 
amount of power consumed by the processor when executing most x86 
based programs. This is particularly useful in laptop computer 
applications. Other types of data processors may be optimized for 
use in consumer appliances (e.g., televisions, video players, 
radios, digital music players, and the like) and office equipment 
(e.g., printers, copiers, fax machines, telephone systems, and 
other peripheral devices) . The general design objectives for data 
processors used in consumer appliances and office equipment are the 
minimization of cost and complexity of the data processor. 

The presence of multiple functional units in processor 
pipelines allows multiple operations to be explicitly encoded (or 
compressed) in a single instruction. These types of processors are 
generically referred to as wide-issue processors or very large 
instruction word (VLIW) processors. VLIW processors implement an 
instruction alignment and dispersal block that is responsible for 
aligning fetched instructions with the correct execution pipeline 
and dispersing the aligned instructions for execution. 

Some VLIW processors, such as the PHILIPS TR I MED I A™ processor 
and the MULT I FLOW TRACE™ processor, fetch compressed instructions 
from memory and load decompressed instructions into the instruction 
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cache. The advantage to this technique is that it does not occur 
on the critical execution path. The disadvantage is that it wastes 
instruction cache space. Other VLIW processors, such as TEXAS 
INSTRUMENTS C6XXX processors and IA-64 processors, store compressed 
5 instructions in the instruction cache and perform instruction 
dispersal and alignment on instruction fetch. In these types of 
VLIW processor, the decompression hardware is on the critical 
instruction and hence temporal efficiency is important. In either 
j'i case, there are two issues that a compression scheme must address: 
lf$ 1) identifying the boundaries between instructions and 2) 

V\\ compressing the operations within instructions. 

H 

r: ~ Because VLIW instructions may consist of multiple machine 

1^ words encoding multiple operations, the following terminology is 

Vil 

fy used to clarify different types of instruction-related data 

1 3 

IS quantities. A bundle is a group of operations to be executed 

□ 

simultaneously. A bundle is encoded as a sequence of syllables. 
A syllable is fixed-size (e.g., 16 bits, 32 bits, and the like) 
unit of addressing. Syllable size is specific to each type of 
processor implementation . 
20 Instruction alignment and dispersal units in prior art 

processors have taken one of three general approaches in defining 
how syllables comprising a bundle are decompressed. One approach 
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involves the use of a separate syllable template in the encoded 
instruction. The MULT I FLOW TRACE™ processor, the earliest 
commercial VLIW, used a bundle format that consisted of one or more 
mask syllables followed by syllables that encoded zero to N 
operations. The mask syllables described the layout of the 
remainder of the bundle. Specifically, the mask syllables defined 
the functional units required by, and hence the dispersal of, the 
operations specified by the remaining syllables in the bundle. On 
instruction fill, a bundle was fully expanded so that the resulting 
instruction in the cache consisted of one syllable per functional 
unit in the machine with a particular syllable encoding denoting a 
null operation. The instruction fetch stage then consisted of 
simply reading the contents of a decompressed instruction cache 
entry. The bundle length is implicit in the mask encoding. 

The second approach to defining how syllables comprising a 
bundle are decompressed involves the use of dispersal bits within 
each operation. TI C6XXX processors use bits within each operation 
syllable to determine how an instruction bundle should be dispersed 
and a bit in each syllable to be used as an end-of -bundle marker. 
In order to expand a bundle, it is necessary to examine each 
syllable in order to determine how to route the syllable to a 
functional unit. 
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The third approach to defining how syllables comprising a 
bundle are decompressed involves the use of template bits within a 
block of memory to indicate how words within that block should be 
combined to form instruction bundles. IA-64 processors use 
dedicated template bits within each memory block to describe the 
dispersal of the syllables encoded in the memory block. This 
template describes both bundle boundaries and the dispersal of 
operations . 

A common implementation issue in VLIW processors is balancing 
the requirement of efficient instruction encoding with the 
requirement of efficient instruction issue hardware. Problems 
arise because the average static parallelism of a program can be 
significantly lower than the available issue slots. The most 
extreme solution requires that all instructions provide an 
operation for each available issue slot, but allows explicit null 
operations for those issue slots that cannot be effectively used by 
a program. While such a solution requires no special hardware in 
the instruction issue unit, it is extremely inefficient in 
instruction memory utilization. 

Therefore, there is a need in the art for a pipelined data 
processor that provides an improved mechanism for encoding 
compressed instructions in memory and for decompressing the 
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instructions on either instruction cache fill or instruction fetch. 
In particular, there is a need for a compression technique that 
balances the efficiency of the compression algorithm with the space 
and time complexity of the decompression hardware. More 
particularly, there is a need for an instruction decompression and 
dispersal scheme that achieves a good balance between memory 
utilization and hardware complexity. 
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SUMMARY OF THE INVENTION 



To address the above-discussed deficiencies of the prior art, 
it is a primary object of the present invention to provide improved 
bundle alignment and dispersal circuitry for use in a data 
processor. According to an advantageous embodiment of the present 
invention, the data processor comprises: 1) C execution clusters, 
each of the C execution clusters comprising an instruction 
execution pipeline having N processing stages capable of executing 
instruction bundles comprising from one to S syllables, wherein 
each the instruction execution pipelines is L lanes wide, each of 
the L lanes capable of receiving one of the one to S syllables of 
the instruction bundles; 2) an instruction cache capable of storing 
a plurality of cache lines, each of the cache lines comprising C*L 
syllables; 3) an instruction issue unit capable of receiving 
fetched ones of the plurality of cache lines and issuing complete 
instruction bundles toward the C execution clusters; and 
4) alignment and dispersal circuitry capable of receiving the 
complete instruction bundles from the instruction issue unit and 
routing each the received complete instruction bundles to a correct 
one of the C execution clusters as a function of at least one 
address bit associated with each of the complete instruction 
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bundles . 

According to one embodiment of the present invention, the 
alignment and dispersal circuitry routs each of the received 
complete instruction bundles to the correct execution cluster as a 
5 function of at least one address bit associated with at least one 
syllable in each complete instruction bundle. 

According to another embodiment of the present invention, the 
alignment and dispersal circuitry routs each of the received 

q complete instruction bundles to the correct execution cluster as a 

H 

]|,q function of a cluster bit associated with each complete instruction 

U 

i;n bundle . 

-J 

According to still another embodiment of the present 

EE 

M invention, the alignment and dispersal circuitry routs each of the 

t:; ; 

\J 

\U received complete instruction bundles to the correct execution 

15 cluster as a function of a stop bit associated with at least one 
syllable in each complete instruction bundle. 

According to yet another embodiment of the present invention, 
the alignment and dispersal circuitry comprises multiplexer 
circuitry capable of routing each received complete instruction 
20 bundle to any one of the C execution clusters. 

According to a further embodiment of the present invention, 
the alignment and dispersal circuitry comprises control logic 
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circuitry capable of controlling the multiplexer circuitry. 

According to a still further embodiment of the present 
invention, the control logic circuitry controls the multiplexer 
circuitry as a function of at least one of: 1) the at least one 
address bit associated with each complete instruction bundle; 2) at 
least one address bit associated with at least one syllable in each 
complete instruction bundle; and 3) a cluster bit associated with 
each complete instruction bundle. 

In one embodiment of the present invention, L=4 . 

In another embodiment of the present invention, C=3 . 

The foregoing has outlined rather broadly the features and 
technical advantages of the present invention so that those skilled 
in the art may better understand the detailed description of the 
invention that follows. Additional features and advantages of the 
invention will be described hereinafter that form the subject of 
the claims of the invention. Those skilled in the art should 
appreciate that they may readily use the conception and the 
specific embodiment disclosed as a basis for modifying or designing 
other structures for carrying out the same purposes of the present 
invention. Those skilled in the art should also realize that such 
equivalent constructions do not depart from the spirit and scope of 
the invention in its broadest form. 
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Before undertaking the DETAILED DESCRIPTION OF THE INVENTION 
below, it may be advantageous to set forth definitions of certain 
words and phrases used throughout this patent document: the terms 
"include" and "comprise," as well as derivatives thereof, mean 
inclusion without limitation; the term "or," is inclusive, meaning 
and/or; the phrases "associated with" and "associated therewith," 
as well as derivatives thereof, may mean to include, be included 
within, interconnect with, contain, be contained within, connect to 
or with, couple to or with, be communicable with, cooperate with, 
interleave, juxtapose, be proximate to, be bound to or with, have, 
have a property of, or the like; and the term "controller" means 
any device, system or part thereof that controls at least one 
operation, such a device may be implemented in hardware, firmware 
or software, or some combination of at least two of the same. It 
should be noted that the functionality associated with any 
particular controller may be centralized or distributed, whether 
locally or remotely. Definitions for certain words and phrases are 
provided throughout this patent document, those of ordinary skill 
in the art should understand that in many, if not most instances, 
such definitions apply to prior, as well as future uses of such 
defined words and phrases. 
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BRIEF DESCRIPTION OP THE DRAWINGS 

For a more complete understanding of the present invention, 
and the advantages thereof, reference is now made to the following 
descriptions taken in conjunction with the accompanying drawings, 
wherein like numbers designate like objects, and in which: 

FIGURE 1 is a block diagram of a processing system that 
contains a data processor in accordance with the principles of the 
present invention; 

FIGURE 2 illustrates the exemplary data processor in greater 
detail according to one embodiment of the present invention; 

FIGURE 3 illustrates a cluster in the exemplary data processor 
according to one embodiment of the present invention; 

FIGURE 4 illustrates the operational stages of the exemplary 
data processor according to one embodiment of the present 
invention; 

FIGURE 5 is a block diagram illustrating selected portions of 
an instruction issue unit according to one embodiment of the 
present invent ion ; 

FIGURE 6 is a block diagram illustrating the contents of an 
instruction cache in the exemplary data processor according to one 
embodiment of the present invention; 
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FIGURE 7A-7D are block diagrams illustrating the flow of 
instruction bundles and syllables through Instruction Issue Unit 
Buffer 0 (IIUBO) and Instruction Issue Unit Buffer 1 (IIUB1) 
according to one embodiment of the present invention; and 

FIGURE 8 illustrates bundle alignment and dispersal circuit 
and selected portions of the exemplary data processor according to 
one embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

FIGURES 1 through 8, discussed below, and the various 
embodiments used to describe the principles of the present 
invention in this patent document are by way of illustration only 
and should not be construed in any way to limit the scope of the 
invention. Those skilled in the art will understand that the 
principles of the present invention may be implemented in any 
suitably arranged data processor. 

FIGURE 1 is a block diagram of processing system 10, which 
contains data processor 100 in accordance with the principles of 
the present invention. Data processor 100 comprises processor 
core 105 and N memory-mapped peripherals interconnected by system 
bus 120. The N memory-mapped peripherals include exemplary memory- 
mapped peripherals 111-114, which are arbitrarily labeled Memory- 
Mapped Peripheral 1, Memory-Mapped Peripheral 2, Memory-Mapped 
Peripheral 3, and Memory-Mapped Peripheral N. Processing system 10 
also comprises main memory 130. In an advantageous embodiment of 
the present invention, main memory 130 may be subdivided into 
program memory 140 and data memory 150. 

The cost and complexity of data processor 100 is minimized by 
excluding from processor core 105 complex functions that may be 
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implemented by one or more of memory-mapped peripherals 111-114. 
For example, memory-mapped peripheral 111 may be a video codec and 
memory-mapped peripheral 112 may be an audio codec. Similarly, 
memory-mapped peripheral 113 may be used to control cache flushing. 
5 The cost and complexity of data processor 100 is further minimized 
by implementing extremely simple exception behavior in processor 
core 105, as explained below in greater detail. 

Processing system 10 is shown in a general level of detail 
t,3 because it is intended to represent any one of a wide variety of 

x 3 

1Q electronic devices, particularly consumer appliances. For example, 

U 

|:n processing system 10 may be a printer rendering system for use in 
,:S a conventional laser printer. Processing system 10 also may 

a 

M represent selected portions of the video and audio compression- 
ill 

f[J decompression circuitry of a video playback system, such as a video 

T ^ 

1% cassette recorder or a digital versatile disk (DVD) player. In 

□ 

another alternative embodiment, processing system 10 may comprise 
selected portions of a cable television set-top box or a stereo 
receiver. The memory-mapped peripherals and a simplified processor 
core reduce the cost of data processor 100 so that it may be used 
20 in such price sensitive consumer appliances. 

In the illustrated embodiment, memory-mapped peripherals 111- 
114 are shown disposed within data processor 100 and program 
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memory 14 0 and data memory 150 are shown external to data 
processor 100. It will be appreciated by those skilled in the art 
that this particular configuration is shown by way of illustration 
only and should not be construed so as to limit the scope of the 
present invention in any way. In alternative embodiments of the 
present invention, one or more of memory-mapped peripherals 111-114 
may be externally coupled to data processor 100. Similarly, in 
another embodiment of the present invention, one or both of program 
memory 140 and data memory 150 may be disposed on-chip in data 
processor 100. 

FIGURE 2 is a more detailed block diagram of exemplary data 
processor 100 according to one embodiment of the present invention. 
Data processor 100 comprises instruction fetch cache and expansion 
unit (IFCEXU) 210, which contains instruction cache 215, and a 
plurality of clusters, including exemplary clusters '220-222. 
Exemplary clusters 220-222 are labeled Cluster 0, Cluster 1 and 
Cluster 2, respectively. Data processor 100 also comprises core 
memory controller 230 and interrupt and exception controller 240. 

A fundamental object of the design of data processor 100 is to 
exclude from the core of data processor 100 most of the functions 
that can be implemented using memory-mapped peripherals external to 
the core of data processor 100. By way of example, in an exemplary 
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embodiment of the present invention, cache flushing may be 
efficiently accomplished using software in conjunction with a small 
memory-mapped device. Another object of the design of data 
processor 100 is to implement a statically scheduled instruction 
pipeline with an extremely simple exception behavior. 

Clusters 22 0-222 are basic execution units that comprise one 
more arithmetic units, a register file, an interface to core memory 
controller 230, including a data cache, and an inter-cluster 
communication interface. In an exemplary embodiment of the present 
invention, the core of data processor 100 may comprise only a 
single cluster, such as exemplary cluster 220. 

Because conventional processor cores can execute multiple 
simultaneously issued operations, the traditional word 
"instruction" is hereby defined with greater specificity. For the 
purposes of this disclosure, the following terminology is adopted. 
An "instruction" or "instruction bundle" is a group of 
simultaneously issued operations encoded as "instruction 
syllables" . Each instruction syllable is encoded as a single 
machine word. Each of the operations constituting an instruction 
bundle may be encoded as one or more instruction syllables. 
Hereafter, the present disclosure may use the shortened forms 
"instruction" and "bundle" interchangeably and may use the 
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shortened form "syllable." In an exemplary embodiment of the 
present invention, each instruction bundle consists of 1 to 4 
instruction syllables. Flow control operations, such as branch or 
call, are encoded in single instruction syllables. 

FIGURE 3 is a more detailed block diagram of cluster 220 in 
data processor 100 according to one embodiment of the present 
invention. Cluster 220 comprises instruction buffer 305, register 
file 310, program counter (PC) and branch unit 315, instruction 
decoder 320, load store unit 325, data cache 330, integer 
units 341-344, and multipliers 351-352. Cluster 220 is implemented 
as an instruction pipeline. 

Instructions are issued to an operand read stage associated 
with register file 310 and then propagated to the execution units 
(i.e., integer units 341-244, multipliers 351-352). Cluster 220 
accepts one bundle comprising one to four syllables in each cycle. 
The bundle may consist of any combination of four integer 
operations, two multiplication operations, one memory operation 
(i.e., read or write) and one branch operation. Operations that 
require long immediates (constants) require two syllables. 

In specifying a cluster, it is assumed that no instruction 
bits are used to associate operations with functional units. For 
example, arithmetic or load/store operations may be placed in any 
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of the four words encoding the operations for a single cycle. This 
may require imposing some addressing alignment restrictions on 
multiply operations and long immediates (constants) . 

This following describes the architectural (programmer 
visible) status of the core of data processor 100. One design 
objective of data processor 100 is to minimize the architectural 
status. All non-user visible status information resides in a 
memory map, in order to reduce the number of special instructions 
required to access such information. 
Program Counter 

In an exemplary embodiment of the present invention, the 
program counter (PC) in program counter and branch unit 315 is 
a 32 -bit byte address pointing to the beginning of the current 
instruction bundle in memory. The two least significant bits 
(LSBs) of the program counter are always zero. In operations that 
assign a value to the program counter, the two LSBs of the assigned 
value are ignored. 
Register File 310 

In an exemplary embodiment, register file 310 contains 64 
words of 32 bits each. Reading Register 0 (i.e., R0) always 
returns the value zero. 
Link Register 
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Register 63 (i.e., R63) is used to address the link register 
by the call and return instructions. The link register (LR) is a 
slaved copy of the architecturally most recent update to R63 . R63 
can be used as a normal register, between call and return 
instructions. The link register is updated only by writes to R63 
and the call instruction. At times the fact that the link register 
is a copy of R63 and not R63 itself may be visible to the 
programmer. This is because the link register and R63 get updated 
at different times in the pipeline. Typically, this occurs in the 
following cases: 

1) I CALL and IGOTO instructions - Since these instructions are 
executed in the decode stage, these operations require that R63"be 
stable. Thus, R63 must not be modified in the instruction bundle 
preceding one of these operations. Otherwise unpredictable results 
may occur in the event of an interrupt; and 

2) An interrupt or exception may update the link register 
incorrectly. Thus, all interrupt and exception handlers must 
explicitly write R63 prior to using the link register through the 
execution of an RFI, ICALL or IGOTO instruction. This requirement 
can be met with a simple MOV instruction from R63 to R63 . 
Branch Bit File 

The branch architecture of data processor 100 uses a set of 
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eight (8) branch bit registers (i.e., BO through B7) that may be 
read or written independently. In an exemplary embodiment of the 
present invention, data processor 100 requires at least one 
instruction to be executed between writing a branch bit and using 
the result in a conditional branch operation. 
Control Registers 

A small number of memory mapped control registers are part of 
the architectural state of data processor 100. These registers 
include support for interrupts and exceptions, and memory 
protection. 

The core of data processor 100 is implemented as a pipeline 
that requires minimal instruction decoding in the early pipeline 
stages. One design objective of the pipeline of data processor 100 
is that it support precise interrupts and exceptions. Data 
processor 100 meets this objective by updating architecturally 
visible state information only during a single write stage. To 
accomplish this, data processor 100 makes extensive use of register 
bypassing circuitry to minimize the performance impact of meeting 
this requirement . 

FIGURE 4 is a block diagram illustrating the operational 
stages of pipeline 400 in exemplary data processor 100 according to 
one embodiment of the present invention. In the illustrated 
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embodiment, the operational stages of data processor 100 are 
address generation stage 401, fetch stage 402, decode stage 403, 
read stage 404, first execution (El) stage 405, second execution 

(E2) stage 406 and write stage 407. 
Address Generation Stage 401 and Fetch Stage 402 

Address generation stage 401 comprises a fetch address 
generator 410 that generates the address of the next instruction to 
be fetched from instruction cache 215. Fetch address generator 410 
receives inputs from exception generator 430 and program counter 
and branch unit 315. Fetch address generator 410 generates an 
instruction fetch address (FADDR) that is applied to instruction 
cache 215 in fetch stage 402 and to an instruction protection unit 

(not shown) that generates an exception if a protection violation 
is found. Any exception generated in fetch stage 4 02 is postponed 
to write stage 407. Instruction buffer 305 in fetch stage 402 
receives instructions as 128 -bit wide words from instruction 
cache 215 and the instructions are dispatched to the cluster. 
Decode Stage 403 

Decode stage 403 comprises instruction decode block 415 and 
program counter (PC) and branch unit 315. Instruction decode 
block 415 receives instructions from instruction buffer 305 and 
decodes the instructions into a group of control signals that are 
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applied to the execution units in El stage 405 and E2 stage 406. 
Program counter and branch unit 315 evaluates branches detected 
within the 12 8 -bit wide words. A taken branch incurs a one cycle 
delay and the instruction being incorrectly fetched while the 
branch instruction is evaluated is discarded. 
Read Stage 404 

In read stage 404, operands are generated by register file 
access, bypass and immediate (constant) generation block 420. The 
sources for operands are the register files, the constants 
(immediates) assembled from the instruction bundle, and any results 
bypassed from operations in later stages in the instruction 
pipeline . 

El Stage 405 and E2 Stage 406 

The instruction execution phase of data processor 100 is 
implemented as two stages, El stage 405 and E2 stage 406 to allow 
two cycle cache access operations and two cycle multiplication 
operations. Exemplary multiplier 351 is illustrated straddling the 
boundary between El stage 405 and E2 stage 4 06 to indicate a two 
cycle multiplication operation. Similarly, load store unit 325 and 
data cache 330 are illustrated straddling the boundary between El 
stage 405 and E2 stage 406 to indicate a two cycle cache access 
operation. Integer operations are performed by integer units, such 
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as IU 341 in El stage 405. Exceptions are generated by exception 
generator 430 in E2 stage 406 and write stage 407. 

Results from fast operations are made available after El 
stage 405 through register bypassing operations. An important 
architectural requirement of data processor 100 is that if the 
results of an operation may be ready after El stage 4 05, then the 
results are always ready after El stage 405. In this manner, the 
visible latency of operations in data processor 100 is fixed. 
Write Stage 407 

At the start of write stage 4 07, any pending exceptions are 
raised and, if no exceptions are raised, results are written by 
register write back and bypass block 44 0 into the appropriate 
register file and/or data cache location. In data processor 100, 
write stage 407 is the "commit point" and operations reaching write 
stage 407 in the instruction pipeline and not "excepted" are 
considered completed. Previous stages (i.e., address generation, 
fetch, decode, read, El, E2) are temporally prior to the commit 
point. Therefore, operations in address generation stage 401, 
fetch stage 402, decode stage 403, read stage 404, El stage 405 and 
E2 stage 406 are flushed when an exception occurs and are acted 
upon in write stage 407. 

As the above description indicates, data processor 100 is a 
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very large instruction word (VLIW) device that allow the parallel 
execution of multiple instructions in two or more instruction 
pipelines in clusters 220-222. In an exemplary embodiment, 
instruction cache 215 comprises cache lines that are 512 bits 
(i.e., 64 bytes) long. Each syllable (i.e., smallest instruction 
size) comprises 32 bits (i.e., 4 bytes), such that a cache line 
comprises 16 syllables. Each instruction syllable is encoded as a 
single 32 -bit machine word. 

Instructions are fetched from instruction cache 215 in groups 
of four syllables (i.e., 128 bits). A complete instruction may 
comprise one, two, three or four syllables. The fetched syllables 
are issued into one of four issues lanes leading into the 
instruction pipeline. The four issue lanes are referred to as 
Issue Lane 0, Issue Lane 1, Issue Lane 2, and Issue Lane 3. 
Because instructions are of variable length and because a branch 
instruction may fetch instructions starting at any point in 
instruction cache 215, there is no guarantee that all of the 
syllables in an instruction will be fetched in the same cache 
access. There also is no guarantee that a particular syllable in 
an instruction will be aligned to a particular issue lane in 
clusters 220-222. 

In order to minimize the amount of delay incurred in fetching 
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instructions, the present invention implements an instruction issue 
unit comprising a sequence of instruction issue unit buffers 
(IIUBs) that temporarily store the syllables of an instruction 
until all syllables of the instruction are present. The complete 
instruction, consisting of one to four syllables, is then issued 
into the four issues lanes of the pipeline. If an instruction has 
less than four syllables, one or more no-operation (NOP) 
instructions are issued into the unused issue lanes. In the 
exemplary embodiment that follows, two instruction issue unit 
buffers are used to buffer up to four 32 -bit syllables. 

However, it should be understood that the selection of these 
values is by way of example only and should not be construed to 
limit the scope of the present invention. Those skilled in the art 
will recognize that other syllable size, buffer size and 
instruction sizes may be used. For example, in an alternate 
embodiment of the present invention, a syllable may comprise eight 
bits, sixteen bits, sixty- four bits, or the like, rather than 
thirty- two bits. Also, the instruction issue unit buffers may hold 
eight syllables, twelve syllables, sixteen syllables, or the like, 
instead of four syllables. 

FIGURE 5 is a block diagram illustrating selected portions of 
instruction issue unit 500 according to one embodiment of the 
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present invention. Instruction issue unit 500 comprises 

instruction issue controller 550, registers 511, 521, 531 and 541, 
multiplexers (MUXs) 512, 522, 532 and 542, registers 513, 523, 533 
and 543, and MUX 560. Registers 513, 523, 533, and 543 comprise a 
first instruction issue unit buffer, referred to hereafter as 
Instruction Issue Unit Buffer 0 (IIUBO) . Registers 511, 521, 531, 
and 541 comprise a second instruction issue unit buffer, referred 
to hereafter as Instruction Issue Unit Buffer 1 (IIUB1) . 

The alignment of cache accesses to instruction cache 215 is 
determined by the branch target alignment. Each cache access after 
an access to a branch target fetches four syllables using the same 
alignment until the next taken branch occurs or a cache line 
boundary is crossed. Each line of the cache is organized as four 
independently addressable cache banks aligned with four issue 
lanes. The first cache bank holds Syllable 0 and is aligned with 
the first issue lane, referred to as Issue Lane 0. The second 
cache bank holds Syllable 1 and is aligned with the second issue 
lane, referred to as Issue Lane 1. The third cache bank holds 
Syllable 2 and is aligned with the third issue lane, referred to as 
Issue Lane 2. The fourth cache bank holds Syllable 3 and is 
aligned with the fourth issue lane, referred to as Issue Lane 3. 

Since there is no guarantee that the first syllable of an 
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instruction is aligned to particular cache bank of issue lane, a 
branch address may access an instruction aligned starting in any 
issue lane and cache bank. Thus, a four syllable instruction may 
begin in the third cache bank (i.e., Syllable 2 position) and be 
aligned to Issue Lane 2. For example, if Instruction A comprises 
four syllables AO, Al, A2 and A3, the four syllables may be fetched 
into Issue Lane 2, Issue Lane 3, Issue Lane 0, and Issue Lane 1. 
A branch instruction is always indicated by the first syllable in 
an instruction bundle. Hence, the outputs of registers 513, 523, 
533 and 543 are input to separate channels of multiplexer (MUX) 560 
and are individually selected by the START OF BUNDLE control 
signal . 

Instruction issue controller 550 controls the transfer of 
Syllable 3, Syllable 2, Syllable 1 and Syllable 0 from instruction 
cache 215 to Issue Lane 3, Issue Lane 2, Issue Lane 1, and Issue 
Lane 0, respectively. A Stop bit is use in the highest syllable of 
an instruction bundle to indicate the end of the bundle. Thus, in 
a three syllable instruction bundle comprising syllables AO, Al and 
A2, the Stop bit is in syllable A2 . 

Ideally, each of the four syllables in an instruction cache 
fetch are loaded from instruction cache 215 directly into the empty 
registers in instruction issue unit (IIU) buffer 0 (i.e., 
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registers 513, 523, 533 and 543) . In such a case, instruction 
issue controller 550 sets the MUX CONTROL signal to switch all four 
syllables to the inputs of registers 513, 523, 533 and 543. 
Instruction issue controller 550 also selectively enables each of 
5 registers 513, 523, 533 and 543 using individual Load Enable 2 
(LE2) signals. 

However, if previously fetched syllables are still in one or 
more of registers 513, 523, 533 and 543 when the next instruction 
*,3 bundle is fetched, instruction issue controller 550 sets the 

Vi 

19 individual MUX CONTROL signals to selectively switch the 

U 

j;n corresponding ones of the four syllables in the next instruction to 

l -4 

<:« the inputs of registers 511, 521, 531 and 541 (i.e., Instruction 

jt 

! ! * Issue Unit (IIU) Buffer 1) . Instruction issue controller 550 also 

pi 

FU selectively enables each of registers 511, 521, 531 and 541 using 

u 

£1 individual Load Enable 1 (LEI) signals. Thus, a syllable may be 

D 

delayed temporarily in IIU Buffer 1 until the corresponding 
register in IIU Buffer 0 becomes empty. 

The operation of instruction issue unit 500 may best be 
understood with reference to FIGURE 6 and FIGURES 7A-7D. FIGURE 6 

20 is a block diagram illustrating the contents of instruction 
cache 215 in exemplary data processor 100 according to one 
embodiment of the present invention. FIGURE 7A-7D are block 
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diagrams illustrating the flow of instruction bundles and syllables 
through Instruction Issue Unit Buffer 0 (IIUBO) and Instruction 
Issue Unit Buffer 1 (IIUB1) according to one embodiment of the 
present invention. 
5 Instruction cache 215 contains an exemplary sequence of seven 

instruction bundles, referred to as Instructions A, B, C, D, E, F 
and G within a single cache line. Instruction A comprises two 
syllables, AO and Al . Instruction B comprises one syllable, BO. 

0 Instruction C comprises two syllable, CO and CI. Instruction D 
IB comprises one syllable, DO. Instruction E comprises one syllable, 

1 : 
t: — 
r 

In EO. Instruction F comprises four syllables, FO, Fl, F2 and F3 . 

Finally, Instruction G comprises one syllable, GO. 

M Initially, IIUBO and IIUB1 are empty and a branch instruction 

IU 

i'LJ begins fetching syllables in groups of four beginning at 

. =s 

F S 

'; cr 

ibS syllable AO. Since IIUBO is empty, instruction issue 

controller 550 sets MUX 512, MUX 522, MUX 532 and MUX 542 so that 
the first four syllables, AO, Al, BO and CO, are fetched into 
IIUBO. Syllable AO is in the Syllable 2 slot in FIGURE 5 and 
therefore is aligned with Issue Lane 2 (register 523) . 

20 Correspondingly, Syllable Al is aligned with Issue Lane 3 
(register 513) , Syllable BO is aligned with Issue Lane 0 
(register 543) , and Syllable C01 is aligned with Issue Lane 1 



- 34 - 



ATTY. DOCKET NO. 00-BN-059 



PATENT 



(register 533) . 

FIGURE 7A shows the positions of AO, Al, BO and CO after they 
are loaded into IIUBO. After AO, Al, BO and CO are loaded into 
IIUBO, instruction issue controller 550 detects the Stop bit in Al, 
indicating that all of Instruction A has been fetched, and issues 
AO and Al into Issue Lanes 2 and 3. Syllables BO and CO remain in 
IIUBO. IIUB1 (i.e., registers 511, 521, 531 and 541) is still 
empty. 

At this point, the next four syllables (CI, DO, E0 and F0) are 
fetched. Since IIUBO is only partially empty, instruction issue 
controller 550 sets MUX 512 and MUX 522 so that syllables CI and DO 
are fetched into IIUBO by the LE2 signal. Instruction issue 
controller 550 also sets MUX 532 and MUX 542 so that the syllables 
E0 and F0 can only be fetched into IIUB1 by the LEI signal. 
FIGURE 7B shows the positions of CI, DO, E0 and F0 after they are 
loaded into IIUBO and IIUB1. After CI, DO, E0 and F0 are loaded, 
instruction issue controller 550 detects the Stop bit in BO, 
indicating that all of Instruction B has been fetched, and issues 
BO into Issue Lane 0. Syllables CO, CI and DO remain in IIUBO. 
IIUB1 contains E0 and F0 . 

At this point, the next four syllables (Fl, F2 , F3 and GO) are 
fetched. Since register 543 in IIUBO is empty after syllable B0 is 
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issued into Issue Lane 0, instruction issue controller 550 sets 
MUX 542 so that syllable E0 is transferred from IIUB1 to IIUBO by 
the LE2 signal. Instruction issue controller 550 also sets 
MUX 512, MUX 522 and MUX 542 so that the syllables Fl, F2 and F3 
are fetched into IIUB1 by the LEI signal. The LEI signal is not 
applied to register 531, which still holds syllable F0 from the 
previous fetch. Therefore, syllable GO is not written to 
register 531 in IIUB1. FIGURE 7c shows the positions of E0, Fl, 
F2, and F3 after they are loaded into IIUBO and IIUB1. After E0, 
Fl, F2 and F3 are loaded, instruction issue controller 550 detects 
the Stop bit in CI, indicating that all of Instruction C has been 
fetched, and issues CO and CI into Issue Lanes 1 and 2. Syllables 
DO and E0 remain in IIUBO. IIUB1 contains F3 , F0, Fl and F2 . 

At this point, the four syllables Fl, F2 , F3 and GO are re- 
fetched in order to fetch GO, which was not loaded on the previous 
fetch. Since registers 533 and 523 in IIUBO are empty after 
syllables CO and CI are issued, instruction issue controller 550 
sets MUX 522 and MUX 532 so that syllables F0 and Fl are 
transferred from IIUB1 to IIUBO by the LE2 signal. Instruction 
issue controller 550 also sets MUX 532 so that the syllable GO is 
fetched into IIUB1 by the LEI signal. The LEI signal is not 
applied to registers 541 and 511, which still hold syllables F3 and 
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F2 from the previous fetch. The LEI signal is also not applied to 
register 521, which is empty after syllable Fl is transferred to 
IIUBO. FIGURE 7C shows the positions of FO, Fl and GO after FO, Fl 
and GO are loaded into IIUBO and IIUB1. After FO, Fl and GO are 
loaded, instruction issue controller 550 detects the Stop bit in 
DO, indicating that all of Instruction D has been fetched, and 
issues DO into Issue Lane 3. Syllables E0, FO and Fl remain in 
IIUBO. IIUB1 contains F3 , GO and F2 . 

As FIGURE 6 and FIGURES 7A-7D demonstrate, instruction issue 
unit 500 continually fetches syllables as far "forward" as possible 
in IIUBO and IIUB1. If IIUBO and IIUB1 are empty, syllables are 
transferred directly into IIUBO, the "forward-most" instruction 
buffer. If a register in IIUBO is not empty, the corresponding 
incoming syllable is instead loaded into IIUB1 and subsequently 
advances into IIUBO when the corresponding register becomes empty. 
In alternate embodiments, one or more additional layers of 
buffering may be added by inserting additional banks of registers 
and multiplexers in front of IIUBO and IIUB1. 

By way of example, if a third layer of buffering is desired, 
a third instruction issue unit buffer, IIUB2, may be implemented by 
inserting a third register and a second multiplexer in each issue 
lane. For example, in Issue Lane 3, the output of the second 



ATTY. DOCKET NO. 00-BN-059 



PATENT 



multiplexer would be connected to the input of register 511, one 
input channel of the second multiplexer would be connected to the 
output of the third register, and the other input channel of the 
second multiplexer would be connected directly to Syllable 3 output 
of instruction cache 215. The input of the third register also 
would be connected directly to Syllable 3 output of instruction 
cache 215. The second multiplexer and the third register would be 
controlled by instruction issue controller 550 using a second 
multiplexer control signal (MUX CONT. 2) and a third load enable 
signal (LE3) . Those skilled in art will recognize that the present 
invention may be similarly extended to implement additional layers 
of instruction issue buffers (i.e., IIUB3, IIUB4, IIUB5 and so 
forth) . 

As noted above, instruction issue unit 500 only issues 
instruction bundles towards the issue lanes in each cluster, but 
does not align syllables and bundles with the proper issue lanes. 
Alignment and dispersal of bundles and syllables in the issue lanes 
are performed further "downstream" from instruction issue unit 500 
in the execution pipeline. According to an advantageous embodiment 
of the present invention, data processor 100 comprises alignment 
and dispersal circuitry between instruction issue unit 500 and the 
issues lane of clusters 220-222. 
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FIGURE 8 illustrates bundle alignment and dispersal 
circuit 810 and selected portions of data processor 100 according 
to one embodiment of the present invention. Bundle alignment and 
dispersal circuit 810 receives issued instruction bundles from 
instruction issue unit 500 and aligns syllables in each bundle with 
the correct ones of Lanes 0-3 in clusters 220-222. 

In the illustrated embodiment in FIGURE 8, both instruction 
issue unit 500 and instruction cache 210 are expanded in size over 
the embodiment illustrated in FIGURE 5. In FIGURE 5, instruction 
issue unit 500 receives only 128 bits from instruction cache 210. 
However, in FIGURE 8, instruction cache 210 has a 384 bit output. 
The output of instruction cache 210 is twelve syllables wide (i.e., 
C*L = 12, where C = 3 clusters and L = 4 lanes) . Instruction issue 
unit 500, which also is expanded in width, receives all twelve 
syllables from instruction cache 210 and issues complete bundles to 
bundle alignment and dispersal circuit 810. 

Bundle alignment and dispersal circuit 810 is capable of 
reordering the syllables in each bundle in order to align the 
syllables, including null syllables, with the correct issue lanes. 
Bundle alignment and dispersal circuit 810 corrects the out-of- 
order alignment of syllables, as demonstrated in FIGURE 5. Bundle 
alignment and dispersal circuit 810 also is a cluster-level 
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alignment device. The outputs of bundle alignment and dispersal 
circuit 810 are switched through multiplexer block 820 such that 
any of the syllables in the twelve syllable output of instruction 
unit 500 may be aligned to any of Lane 0, Lane 1, Lane 2 and Lane 3 
5 in clusters 220-222. 

Two bits, a bundle stop bit and a cluster start bit, are 
reserved in each syllable to indicate the start of the next cluster 
and the end of a current bundle. If the bundle stop bit is set in 
1 3 a syllable, it means that the current bundle is complete and the 
^ next syllable in memory is from the next bundle. If the cluster 
ffl start bit is set in a syllable, it means that the next syllable in 

e ™ memory is to be loaded in to the next sequential cluster. The 

it 

U positions of the multiplexers in multiplexer block 820 are 

m 

j'LJ controlled by decode logic 830, which receives cluster start bits 

. ~: 

1;| and bundle stop bits. Decode logic 830 also selects the correct 
lane in a cluster using the bundle address from the program counter 
(PC) . 

The key advantages of bundle alignment and dispersal 
circuit 810 are that no extra instruction bits are used in the most 
20 frequent instruction encodings. Bundle alignment and dispersal 
circuit 810 also does not require decoding of instructions in order 
to route and disperse operations in pipeline 400. All of the prior 
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art methods of aligning and dispersing bundles and syllables use 
explicit instruction bits to describe the dispersal of operations 
to functional units in addition to bit encoding to determine the 
boundary between bundles. The present invention encodes bundles 
5 without using data bits for instruction dispersal. The present 
invention identifies the boundary between bundles by identifying 
the Stop bit in the most significant syllable in each bundle. The 
present invention also uses the memory address of a syllable to 

u 

i.p determine the routing within the instruction pipeline. 

\$ For most operations, there are no address alignment 

f ■ " 

Pfl restrictions and the operation can be performed on any of a set of 

"■-3 

identical functional units. For infrequently used operations, the 

j=« present invention may impose address alignment restrictions. These 

FU 

|y can always be satisfied by inserting null operations. In an 
15 exemplary embodiment of the present invention, the two least 
significant bits of a syllable memory address determine the lane of 
the syllable. Furthermore, infrequent operations may be subject to 
address restrictions to avoid syllable routing. For example, 
multiply instructions may be limited to odd memory locations and 
20 therefore odd issue lanes. 

The forgoing description is suitable for aligning and 
dispersing instructions in the case of a single execution path 
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(i.e.," cluster). However, as illustrated in FIGURE 8, data 
processor 100 subdivides the execution path into multiple clusters 
(e.g., three), each of which has a separate set of register files 
and execution units. In data processor 100, instruction alignment 
and dispersal with a cluster proceed as described above, and bundle 
alignment and dispersal 810, decode logic 830, and multiplexer 
block 820 align and disperse bundles to the multiple clusters. 

To handle bundle instruction dispersal and alignment for 
multiple clusters, the present invention reserves one bit of the 
syllable encoding for a cluster bit, which is used to indicate 
either the first or last syllable for a cluster depending on the 
specific implementation. As noted above, one embodiment uses a 
Stop bit in the most significant syllable to define the cluster 
boundary. Syllables within a bundle are encoded in cluster order. 
The syllables for cluster N are all at memory addresses that are 
lower than those for cluster N+l. 

Although the present invention has been described in detail, 
those skilled in the art should understand that they can make 
various changes, substitutions and alterations herein without 
departing from the spirit and scope of the invention in its 
broadest form. 



